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This survey of the standardized testing program 
summarizes the data accumulated from the most recent administration 
of selected Instruments in October 1973. It compares these findings 
with information from' previous years and points to a few trends and 
possible conclusions. Assessment of mental abilities— 1973-74 is 
presented ^f or grade 1, and a'Ssessment of aptitude and 
achievement— 1973-74 is presented for grades 5 and 8. The ACT report 
includes/ information on the four measures of academic ability and 
data about additional student characteristics that appear to have a 
bearing on success in college. The appendixes contain the testing 
schedule 1969-74 and item analysis for grades 5 and 8. (RC) 
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INTRODUCTION 



This survey of the standardized testir.g program summarizes 
the data accumulated from the'^most recent administration of se- 



lected instruments in, October 1973. It compares these findings 
with information from previous years and points to a few trends^ 

and possible conclusions. . / 

/ 



We hope it will be helpful to those who make use of test 
results in their work with individual students, classrooms and 
district-wide program planning. We trust it will be of interest 
also to the more generally concerned individuals who may wish to 
learn more about this aspect of the work of the State Department 
of Education. 

If questions arise which are not adequately covered in this 
report, please contact the Evaluation, Assess«ient and Testing Unit 
for clarification. 



April 1974 
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GRADE ONE-ASSESSMENT 'OF 
MEWPAL ABILITIES - 1973-74 

This is the third vear in which baseline information has been 
gathered in the fir'st grade through the administration of the Otis- 
Lennon Mental Ability Test (OLMAT) , Primary II, Fonn J. All stu- 
dents in grade one, approximately 21,000, took this test at some 
time during the first two weeks of October. Results are shown in 
Table 1 for 1973-74 and the two previous years. Scores are reported 
on an age deviation scale ranging from 1 to 150 with a mean of 100 
and a standard deviation of 16 points. 

The total state mean has increa ed from 96.0 in 1971-72 to 98.5 
in 1973-74. All sub-groups contribute to this increase except the 
category "Other." An increase, not included in the totals, is shown 
in the mean score for the 229 children who took the test in Spanish, 
from 84.0 in 1972-73, to 87.7 in 1973-74. 

The category "Asian American" was added for the current vearj 
otherwise there has been no change in the breakdown of \thnic sub- 
groups, it is interesting to note for 1973 increases rangino from 
^9 tQ 1.3 in scores attained by Spanish, Indian and Black first- 
graders. This may be attributed, in part, to some of the special 
programs that have been initiated recently. The Spanish orouo frcores 
have increased an impressive 4^0 from 1971-72 to 1973-'4. 
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. reconunendation was made in earlier reports that "greater and 
more specific effort should be expended to enrich the educational 
experiences of minority group and bilingual children at the pre-first 
level and especj.ally during the first year of school."* A further 
recommendation was made to continue testing to gain information on 
^he effectiveness of such programs jis they were introduced. 

The Bilingual Multicultural Act, implemented in 1973, provides 
funds to insure equal educational opportunities for culturally di- 
verse students in grades K-3. Data for OLMAT and other tests were 
used to show a need for special programs designed to emphasize the 
cultural background of the student, encourage affective development, 
and improve proficiency in two languages. 

In 1972-73, 33 districts offered bilingual education programs to 
their 8,961 students at a cost of 52,590,034. Twenty-eight^- schools 
had kindergarten programs and' 71 had first grade progi^ams. in 1973-74, 
there are 14,535 students in bilingual classes costing $2,556,419. It 
is estimated that ; 3,696 children in grades 1-6 need such programs. 

_ Xn_addiiiorM-theLl973 legislature provided $800,000 to fund en- 
richment programs at the pre-ffrst leve^^^^ chil- 
dren attending various pre-first classes, i.e., Johnson-0 ' Mai ley , Title I, 
and others, in 77 districts throughout the state. Several in^ortant com- 
ponents of the early childhood education enrichment programs are pre- and 

♦"Assessment of Mental Abilities, School year 1972-73, Grade One," 
State Department of Education, March 1973, and school year 1971-72, 
* March 1972. 



PQSt-testing of the pupils with the Boehm Test ,of Basic Concepts, the 
Vineland Social Maturity Scale, and a psychoroetor check list. There 
also is a coir«ietency -based evaluation of the effectiveness of on-site, 
in-service training of teachers and aides. This training can lead to 
15 hours of college credit. ,Data on these programs will be. available 
at the end of school year 1973-74. Next year approximately 12,800 
children will be enrolled in pre-first classes. It is estimated that 
20,205 are eligible. « 

One of the purposes of the first grade statewide testing, is t©^ 
note trends and patterns in entering scholastic ability levels as 
well as to provide infq^ation about questions -of general concern. 
Specifically, much enphasis , has been placed upon the impact of pre- 
school programs in New Mexico. Therefore, schools and classroom 
teachers were asked to provide information concerning each child's 
participation in pre-school programs. 

Table 2 shows the scores attained by children who had attended 
some type ^f formal educational program prior to entering first grade 
in September 1973. Graph A illustrates the effect of this variable . 
within the ethnic groups tested. ^ 

I - t 

It is immediately apparent that early childhood education pro- 
grams of seven months or more duration have a positive effect on stu- 
dent performance on the Otis-Lennon Mental Ability Test» Those chil- 
dren who had participated in such pre-first grade learning experiences 



M 

I 



in 



^ o 

00 



in 
o 



o 
o 



o 

0> 



CD 

i 



i 



s 



IS.. o o 



V 



5 



04 



•13 



0 



pH ' 00 

00 '00- 



CM fo iH, 
• oo » 

00 00 



CM IS* 
C4 



lO 00 Q> OJ 

• cn • >o 



0 

95 



d 

i 

I 



s^ 

o 



0\ CM 
• CM 

CM cn 

OH 



so 10 
00-^* 



O iH 

• m 

m CM 

«n 







00 00 


cn ON 




• cn 


• |s* 


* CM 




M vD 


cn ^ 


in 




O • 


s 


o 




iH CM 







• SO 
0\ CD 
OS * 



i 

0) 

14 



I 



0) 



H 

o 



o 
u 

M 



O 

CO 

c 



U3 

8 

O 

i 

M 

5 

Pi 



o 

I 



» 

< 



tn 

c 
o 

sr 

vO 
I 



u 

o 



tn 



M 

O 
(0 



to 
0* 



■ 


(0 


■ 




■ 


0 


B 


iH 










i 










o 
c 



o 

ON 



00 



ERIC 



•5- 



scored from l»3to S.8 pointg higher than others in the same ethnic 
gxoup who h£»d no such preparation for' first grade. 

g 

^ Programs, of jsix months or less duration do not seem to have as 
mvich impact. There is little difference in scores for those children 
who have had a iirief early childhood education experience when ccan- 
pared with thos«2 who have had none. In some instances, a negative 
effect is observed, e.g., in "indian" and "Other" categories, though 

the numbers of students involved are so ?mall,as to make \^irm cohclu- 

» ■ \ • • 

\ 

sions. difficult. » - ^ 

Approximately 560 youngsters answered fewer than 15, out of a 
possible 55, questions. According to the test publisher, these stu- 
dents should Be^retested with a lower level of the test or referred 
for individual testing and evaluation. On no account should they be 

> 

^'labeled" by this one test administration. 

To assist the classroom teachers in using these test results 

more effectively, the State Department of Education requested that 

I 

the test company provide a specialized handbook for New Mexico 
Schools, Questions and Answers - A Supplementary Teacher ' s Guide . 
Thi^s publication gives st4p-by-step directions for interpretation 
and application of scores in working with individual students # with 
groups'^ and in parent conferences. Regional workshops were al^ con- 
ducted by the SDE, with the assistance of test company representative 
as the results we re returned to the schools in November and December, 
with, special enqphasis on teacher use in New Mexico classrooms. , 



in conclusion, although, the overall pattern remains much the 
same, gains are beginning to appear in the scores of the sub-groups 
which have been of greatest concern since the inception of the test 
ing program. The changes in first grade scholastic aptitude te'st ^ 
.results appear to be positive. Sustained effort is increasingly 
necessary to provide improved educational opportunities for those 
students who begin school at an educational disadvantage. 

Data gathering should be continued to provide information for 
parents, children, teachers, administrators and others involved in. 
the education process. 



GRADE 5 - ASSESSMENT OF 
APTITUDE AND ACHIEVEMENT - 1973-74 



Approximately 24,000 fifth graders were tested in .October 1973 
with the Short Form Test of Academic Aptitude (SFTAA) Level 3, and 
the Comprehensive Tests of Basic Skills (CTBS) Form 0, Level 2. 
The 1973 testing provides the third year of statewide results at 
this grade level and time of administration. In 1969-70 the Cali- 
fornia Test of Mental Maturity (CTMM) was used with the CTBS, instead 
of the SFTAA, -on an 8% sample of fifth graders, and in April 1971 all 
fifth grade students were tested with the CTMM and CTBS. Appendix A 
gives a schedule of standardized tests administered at all grade levels 
to date* 

From the testing described above, three years of completely com- 
parable data and two years of relatively comparable data are available. 
Table 1 gives aptitude scores (on an age deviation^ standard scale rang- 
ing from 1 to 150 with a mean of 100 and a standard deviation of 16) 
attained by various groups over this period of time. 



TABLE 1 
Grade 5 



ACADEMIC APTITUDE SCOKbS ox bKUUF rUK r Xyii 








GROUP iybv- /U ly /w-* fx ly /!"" /<- 






1973-74 


Anglo 111 109 lOJ 






1 no 


Spafiish 96 95 91 


• 






Indian^ 92 91 85 








Black 92 93 89 






oo 


ft 

Asian American 








Other 103 104 98 






98 


Non-Public NA 108 iUl 


99 




1 m 

XVJ J. 


Public 102 102 96 


96 - 




95 


National 100 100 100 


100 




100 


*Acadeinic aptitude scores for ethnic groups were 
school year 1972-73 • 


i 

not provided 


for 


The effect of the change in instruments as well as# 


possibly # 


the time of testing is immediately apparent in the difference 


in 


scores from 1970-71 to 1971-72. In addition there has been a 


one- 


point drop in most sub-group scores from 1*^71-72 


to 1973- 


•74, 


The 


state mean of 95 is significantly below the national norm of 


100. 


Table 2 gives achievement scores over this same five-year 


period. It is important to note that comparison between 


the 





ethnic sub-group scores for 1973-74 and preceding years is not 
practical because for 1973 the grade equivalents were computed 



from thc^means of raw scores (RSj whereas, in previous years the 
raw scores were converted to grade equivalents and means (M) v;ere 
derived frcan the converted scores. For all other groups, however, 
the mean grade equivalents were computed and are directlv compar- 
able. For those years when the tests were administered in April, 
the scores have been -adjusted by the percentage gain method. 

• . " TABLE 2 

Grade 5 

TOTAL BATTERY ACHIEVEMENT SCORE BY ETHNIC SUB-GROUP 
DISTRICT SIZE, PUBLIC, NON-PUBLIC, 
AND NATIONAL REFERENCE GROU^ 

Mean Grade Equivalent 



GROUP , 


1969-70 1970-71 


1971-72 


1972-73 


1973-74 

4 


Anglo 


5*5 


5.5 


5.3 


5.3 


4.9* 


Spanish 


4.3 


4.3 


4.3 


4.3 


4.1* 


Indian 


3.7 


3.9 


3.8 


3.8 


3.7* 


Black 


3.9 


4.2 


. 4.1 


4.4 


4.0* 


Asian Ainerican 








4.4* 


Other 


4.3 


4.1 


5.0 


5.1 


4.7* 


1-500 


4.3 


4.8 


4.6 


4.8 


4.7 


501-1000 


4.1 


4.3 


4.5 


4.5 


4.4 


1001-5000 


4.8 


4.6 


4.6 


4.6 


4.5 


Over 5000 


4.8 


5.1 


4.8 


4.8 


4.6 


Non-Public 


NA 


5.6 


5.1 


5.0 


5.1 


Public 


4.9 


4.9 


4.7 


4.6 


4.6' 


National 


5.1 


5.1 


5.1 


5.1 


5.1 


*Raw Score Grade Equivalent 











Graph A displays subtest scores for a throe-year period. The group 
tested in October 1971 attained higher achievement scores than either 
of the two groups tested in subseuuent vears, with an academic apti- 
tude score only one point higher than the October 197,3 group. The 
1973 class out-performed the 1^7? fifth graders in reading compre- 
hension and language expression, , while the 1972 group was slightly 
better in arithmetic comprehension. Appendix B gives CTBS and SFTAA 
scores for three, years by total group and three major ethnic sub-groups 

An item analvsis for the entire state has beian compiled and a 
summary of those items which appeared c'-^mparatively difficult for 
this year's fifth graders, i.e., on which there was a 10% difference 
between the New Mexico percent of "right responses and the national 
percent right, is attached as Appendix D. Each district receives 
a similar analysis and is encouraged to make optimum use of this and 
all other reports to identify curriculum areas in need of special 
attention. 

For the state as a whole. Language Mechanics (punctuation and 
capitalization) , Spelling, Arithmetic Computation (particularly sub- 
traction, iflultiplication and division of fractions) and Arithmetic 
Applications appear to be subjects of special concern. 

In April 1971, the CTBS were administered to 13,623 fifth graders 
and an item analysis was provided. A comparison between analyses for 
the 1971 and 1973 classes is given in Table 4. 



-11 



\ TABLE 3 

\ 

Grade 5 - April 1971 & October 1973 
Item Analysis - Sub-test Totals 

4-71 

" CTBP 02 
Grade 5.7 



10-73 
CTBS Q2 
Grade 5.1 







% Right 


Difference 


% Right 


1. 


Reading Vocabulary 


62 


7 


55 


2. 


Reading Comprehension 


61 


7 


54 


3. 


Language Mechanics 


60 


12 


48 - 


4. 


Languaae Expression 


58 


7 


51 


5. 


Language Spelling 


68 


14 


54 


6. 


Arithmetic Computation 


70 


. 15 . 


55 


7. 


Arithmetic Concepts 


64 


10 


' 54 


8. 


Arthmetic Applications 


60 


13 


47 


9. 


Study Skills - Reference 


53 


8 


45 


10. 


Study Skills - Graphic 


6p 


8 


52 



It is immediately apparent that the October class achieved a lower 
percent right in every sub-test than the April group. Generally this 
can be attributed to the fact that the April group had been in school 
six months longer before taking the test, with a consequent learning in- 
crement. There are, however, some differences which appear to be great 
enough to call for further investioation in Language Mechanics, Spelling 
Arithmetic Con^jutation, Concepts, and Applications. 



If these skills are important to Hew Mexico fifth grAders, then 
■ spec'I^r' concern ;=;inav be expressed on the ba'sis of this test as an in- 
dicator of student performance... The Evaluation Unit has prepared 
- guidelines to assist teachers and administrators in using these test 
results, and workshops are conducted each year after reports are re- 



turned to the districts. In addition, Field Services Consultants 
make extensive use of these data in working with local education 
agencies to improve educational opportunities for all students in 
N^w Mexico Schools. 
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This report is based on the performance of 24»782 eighth grade 
students in both public and non-public schools in New Mexico who took 
the Short Form' Test of Academic Aptitude (SFTAA) Level 4, and the Com- 
preherisive Tests of Basic Skills (CTBS) Form Q, Level 3, in October 
1973 , as part of the state-mandated ^evaluation program. This is the 
third consecutive year these two tests have been administered at this . 
level. The SFTAA was optional for eighth graders this year, and 4,492 
Students did not take it*. 

No great differences are apparent over this period of time in 
either aptitude or achievement. The pattern remains essentially the 
saiefor all sub-groups. There has been a three-month drop from 
1972-73 in grade equivalent scores for schools with enrollment over 
5,000. Nonpublic schools continue to score higher than public schools, 
In looking at the ethnic sub-group scores, .we encounter the same sit- 
uation as with the fifths^de: the se^lective frequency distributions 
for these populations were coss^uted in raw score grade equivalents 
rather than mean girade equivalent^^so direct coirparison with previous 
years is not feasible. All other score^ are reported in mean grade 
. equivalents. 



Tables 1 and 2 display total^ .scores attained by various sub-groups 
over a three-year "period. .' 

TABLE 1 - Grade 8 
ACADEMIC APTITUDE SCORES* BY ETHNIC GROUP 
■ ■ AND PUBLIC-NONPUBLIC CATEGORY .FOR THREE YEARS 

»* 1973-74 



GROUP 


1971-72 


1972- 


Anglo 


103 


NA 


■ Sjpanish 


91 


NA 


Indian 


85 _ 


- NA 


Black. 


88 


NA 


Asian American 






Other 


100 


na" 


Non-Public 


100 


102 


Public 


97 


97 


State Total 






National 


100 


100 



103 
92 
86 

.90 
99 

100 

103 
96 
97 

100 



♦Based on a standard scale with a range of 1-150» a mean of 100» and 
a standard deviation of 16. . 

♦♦Scores for ethnic subgroups not provided. 



TABLE 2 

TOTAL BATTERY ACHIEVEMENT- MEAN GRADE EQUIVALENT BY 
ETHNIC GROUP, DISTRICT SIZE,- AND PUBLIC-NONPUBLIC CATEGORY 

FOR THREE YEARS " * 



GROUP 

Anglo 
Spanish 
Indian 
Black 

Asian American 

Other 

Under 500 

50^-1000 

1001-5000 

Over 5000 

Non-Public 

Public 

Total 

National 



1971-72 

8.2 
6.2 
5.4 
5.8 

7.7 
6.8 
6.4 . 
6.6 
7.4 
7.6 
^7.2 

8.1 



1972-73 

8,2 

6.4 
5.5 
6.1,. 

y 

7; 3 
6,5 
6.7 
7.4 
7.7 
'7.2 

8.1 



1973-74 

-7.8* ' 
6.3* 
5.6* 
^5. '9* 
7.1* 
7.5* 
7.0* 
6.5 
6.6 
7.1 
7.6 
7.1 
7.1 
8.1 



N-Cpunt 
1973-74 

10,805 
10,019 
1.794 
470 
107 
878 
678 
99% 
6,707 
14,B74 
1,129 
23,253 
24,382 



♦Raw Score Grade Equivalent 
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Graph A presents CTBS subtest scores for the past three years, 

which indicate reading vocabulary achievement has remained constant 

over this period while reading comprehension has declined. Language 

mechanics, express ioQ and spelling scores increased over th^f pre- 

vious year, while arithmetic t:onc9pts and application scores decreased. 

No score was close to grade placement at time of testing, except 

study skiil-s. Appendix C gives actual state means over this period 

of time for the total group and the three major ethnic sub-groups. 

• . ' ■■ 

Comparing grade equivalent scores attained by fifth graders in 
1970-71 with the scores this same group achieved as eighth graders 

r 

C 

ixt 1973-74, „ (Table 3) , we find that no sub-group gained three years. 
(This comparison could not be made for the ethnic sub-groups because 
of the different process used to compute their means in 1973-74*) 

TABLE 3 

/ *. AVERAGE. GRADE EQUIVALENT SCORES OF EIGHTH GRADE 
" * STUDENTS AND THEIR SCORES 'THREE YEARS 

^ EARLIER AS .FIFTH GRADE STUDENTS 
' * BY SUB-GROUP 



• 


Grade 5 
1970-71 


Grade 8 
1973-74 




Increeise 


1-500 


4.8 


7.0 




2.2 


501-1000 


4.3 


6.5 




2.2 


1001-5000 


4.6 


6.6 




2.0 


5000 + 


5.1 


7.1 




2.0 


Non-Public 


5.6 


7.6 




2.0 


Public 


* 

4.9 


. 7.1 . 


• 


2.2 ' 


National 


5,1 


8.1 
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* 

An. in-depth study of the item analysis - for the entire state has 
been conducted by the Evaluation, Assessment and Testing Unit as well 
"as bv other units of the State Department of Education, and some find- 
ings are discussed below. x 

•Every district has received an item analysis each year and has 
been encouraged to use it at the local level in identifying areas ^ 
of special concern. It contains the nuxnber and percent of students ^ 
answering correctly, incorrectly or omitting each item, and the per- 
cent of students in the publisher's refereHce ^roup who answered 
correctly at the time the test was standardized (March 1968) . ^ . 

Ideally, for purposes of comparison, a standardized test should 
be given at the same time of the- year it was administered to the 'na- 
tional s-^iple. Howev€arj New Mexico administers this test in October. 
By interpolation, a method of estimation only, it is possible to ad- 
just- the national reference group to reflect this difference in admin- 
istration time. However,, rather than use this process, an arbitrary 
figure ot ten percentage points variance has been selected as the 
criterion for determining a closer examination of the individual 
items. Table 4 shows the number of items in each 'subtest' on which ^ 
the New Mexico population scored at least ten points below the National 
. sas^le. 
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•TABLE 4 
Grade 6 - October 'l973 . 

TOTAL NUMBER OF ITEM^ BY' SUB-^TEST ON IWICH NEW MEXICO STUDENTS^ 
SCORED 1C% QR I^RE BELOW THE NATICNAL REFERENCE GROUP 



Subtest 

1« Reading 
Vocabulary 

2. Reading 

Comprehens ion 

« 

3 • Language 
Mechanics 

4 • Language 
Expression 

5. Spelling 

6. Arithmetic 
computation , 

7. Arthmetic 
Concepts 

8. Arithmetilc' 
Applicatrons 

9.. Study Skills 
* Reference 

10. Study Skills 
Graphic 



Total Number 
of It ems 

'. ' V" 

40 



45 
35 

30 

30 

48 
30 
20 
20 
30 



NM Scored 
10% below 
T— '■• 

♦ «. 

26 
20 



10 , 

13 
5 

29 

18 

14 . 



NM % 
Right' 



59 

ft 

59 
P 

■ • 

60 

53 
58 

60 



r 



61- ■=> 



56 



61 



57 



Nat € 
Right 



6% 
■68 

6b 

64 

* 

70 
73 
• 71 
71 
,66 
54 



The 40 items in the Reading Vocabulary subtest consist of short 
phrases with one word underlined and fou,r possible synonyms for the 
underlined word. The student's task is td s^elect the best wolrd and 
mark the appropriate bubble on the answer sheet. There were 26 interns 
that were "of more than avejrage difficulty for New Mexico eighth graders 
but the two that caused the greatest discrepancy were "installment" 



which only 36% identified as ••payment" (compared to 67% in the national 
sapiple) and "vary^^ which 34% defined correctly as meaning "alter" (com- 
pared to 57% nationally). ' ' - . 



The Reading Comprehension subtest includes the processes of para- 
phrasing, interpretation, inference, determining relationships, and 
drawing conclusions. The items which appeared more difficult for 
New Mexico students than for the refefence group ^ealt with determin- 
ing the main thought of, at best title for, brief, paragraphs that, 

_ ; ■ ' . ■ . 

appeared in the test booklet; and only 42% could translate- the year 

"i ' ' • . 

'l936, for example, into the correct century, as compared to 68% of r;' 

the standardization sample. They perforsjed better than t)i6**fational 

reference group (75% vs 74%) on an item that asked them to infer. lo- 

. ^ 

cation pf a city from the language spoken there. » 



. ■ Faulty construction and confusing directions , re reflected -in tlie 
Language Mechanics subtest. It is diff-cult to determine the effect, 
of' ^ese tactors on the pertorroance of Ne\* Mexico- eighth graders. 
Nevertheless, it appears that correct use of the comma and colon gire 




two problem are^ in punctuation; and capitalization of wor^s in a 

c 

title is another area of concern. It should be noted, however, -that 
again New Mexico students scored above the reference ^grbub (7S% to 72%) 
on an item which-.cal'led for correctly capitalizing the naiiip of a month. 

•the next subtest. Language Expression, deals with correct usage 
and economy and clarity of expression. • The task here is to select the 



correct wor4 from four possibilities, including "Best as it is" to 
fill the blanks in various sentences printed in the test booklet. 
The items that proved most, difficult in this section were two that 
have tripped up more erudite individuals than junior high schoo;L 
students: the possessives "whose" and "its." 

■ The last five items pertain to a poem, and the correct choices 
must fit the meter as well as the meaning. It is interesting -to 
note here that on one of these questions only 22% of New Mexico 
students and 24% of the national sample answered correctly. This 
is the lowest score for the national group and the lowest but one 
for Mew Mexico. The correct response was only one word, and appar- 
ently roost of the students did not believe that was a reasonable 
choice. 



The s|)§lling subtest, which calls for finding the mi'Sspelled 
wbrd^n a'groxs^ of five which includes the- choice "None," contained 
the item* on Vhich ^lew Mexico eighth gradefs scored lowest. Number 29, 
Only 21% ;sj>otted an-. extra L on the end of the word "gr-aceful." A 
less than impressive 41% of " the national reference grpup correctly 
answered this item. v 



• * ■ • . - .■ •■ 



S Looking at Arithmetic ConS)utatiQp,.we\find New Mexico students /: 
; . •' •.. ••"-,> '. , . r ' • - 

^scoring above the standardization sample on three items dealing with . 

decimals and money. On the»,other han<i, accordiftg^to this- test, pro- 
^ ialems with common fractions/ mixed fractions, polynomials, and exponent? 
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are apparent. Specific item numbers and a brief description of the 
type of problem are included in .Appendix E. 

r «• 

In the Arithmetic Concepts stibtest we again find three items on 
which our state population performs better than the national sample? 
these items deal with place- value, simplifying an arithmetic explana- 
tion, and estimating the amount of liquid in a milliliter graduate. • 

The Arithmetic Applications subtest includes the cognitive pro- 
cesses of interpretation, analysis and organization. New Mexico stu- 
dent performance, as measured by grade equivalents, -is lower on this 
subtest than any other. (See Appendix C.) These items require a 
fairl^ high degree of reading comprehension. The students appear to 
have particular difficulty in changing inches to feet, ounces to pounds, 
and pints to gallons. Computing square feet and percent is a real chal- 
lenge, and once again common fractions prove a stumbling block. 

The one area in which New Mexico eighth graders score at or above 
the National reference qroup is Study Skills. They do particularly 
well in the graphics portion which calls for interpreting tables, charts 
graphs and maps. Processes involved include dictionary and library use, 
converting symbols, determining relationships, drawing conclusions, and 
educing extended meanings. One concept which caused some difficulty 
was "least gain" or "smallest difference." 
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In summary, it would appear the results of this one test 

administration that New Mexico eighth graders experience difficulty 



in: 



- Eliciting the main thought from their reading 

- Using the comma, colon and capitalization 
correctly in written work 

- Deciding when to use "its" and "whose" 

- Solving pf'oblems involving common and 
mixed fracti6ns 

- Converting ounces and pounds, feet and 
inches, pints and quarts to . their metric 
equivalents 

- Computing percentages 



It should be stressed that these findings will vary from district 
to district and even from building to building within district. Also, 
district objectives will dettermine the emphasis given to various skills 
and resultant concerns regarding indications provided by this testing. 



TI 

Some of the eighth gradeirs who took the CTBS in October 1973 were 
among the 13,600 fifth grade students who took Form 0, Level 2, of the 
same test in April, 1971. This is the first opportunity we have had 
to study the performance statewide of the same group of students over 
a period of time. Table 5 shows the percent right achieved on the 
various subtests and the difference between percent right at the fifth 
grade, seventh month, and eighth grade, first month. 



^ TABLE 5 

Grade 8 - October 19? 3 and Gra'lc b - April 1971 

A COMPARISON OF PERCENT RICMT BY SUB-TESTS ADMINISTERED TO THE 
SAME POPULATION IN APRIL 1971 AND OCTOBER 1973 







CTBS Q2 
4-71 




CTBS Q3 
10-73 




Subtest 


Grade 5.7 
« Right 


Diff 


Grade 8.1 
% Right 


1. 


■ -5 

Reading Vocabulary 


62 


3 


59 


2. 


Reading Conqorehension 


61 


2 


59 


3. 


Language Mechanics 


60 


b 


60 


4. 


Lemguage Expression 


■ 58 


5 


53 


5. 


■ Language Spelling 


68 ' 


10 


58 


6. 


Arithmetic Computation 


70 


10 


60 


7. 


Arithmetic Concepts 


64 


3 


61 


8. 


Arithmetic Applications 


60 


4 


56 


9. 


5tudy Skills - Reference 53 


4« 


61 


10. 


Study Skills - Graphic 


60 


3 


57 



In only one area (Study Skills - Reference) do the eighth graders 
perform better than they did as fifth graders. This may be accounted \ 
for, at least in part, by the six-month differential in time of year 
when tests were administered. However, for those areas where there 
was considerable difference (Arithmetic Conqoutation and Spelling) it 



might be advisable to consider other factprs. 



The Spelling subtest is an editing exercise in which the student 
is asked to select the misspelled word from a list of five which in-' 
eludes the choice "None." This differs from the -usual spelling test 
in which words arp read aloud and the student writes, them down.. It 
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is possible, also, that spelling is not stressed at the junior high 
level as it is at the elementary* level. 

t 

With regard to the Arithmetic Computation subtest, it is par- 
ticularly interesting to note that in fifth grade this group had 
difficulty with addition and subtraction .of cbmmoh fractions but 
was scored above the national reference group on multiplication of 
common fractions and apparently had no difficulty with division of 
common fractions, but in eighth grade it!' was considerably below the 
national reference group on all four processes. (See Appendix E) . 

H • 

Instruction in Study Skills apparently is stressed in the years 
between fifth and eighth grades since this is one of the strong points 
in the eighth grade item analysis. At the fifth grade this same group 
scored slightly below the national reference group. When there appar- . 
ently is such a good grasp of these techniques at the eighth grade 
level, it is diffiuclt to account for the poor performance in related 
subject areas. It indicates again the need for a curriculum survey in 
the intervening years. 

To assist the districts in deriving maximum benefit from all test . 

~ — - ^ ^ 

data, the Evaluation Unit has prepared a publication entitled "Guide- 
iin^s for Better Use of Test Results." In addition, post- test work- 
shops each year acquaint teachers, test coordinators and administrators 

» 

with the possibilities for ixi^jroving instructional, programs, other units 



of the State Department of Education use this information in various 
ways to assist the districts in. making necessary curriculum modifica- 
tions, all for the purpose of providing the best education possible 
for all New Mexico Students. 



\ ■ - 

ACT REPOBT 
February 1974 

Each fall the American College Testing Program Research Ser- 
vices-prepares a High School Profile Report for all students within 
the State who completed the ACT examination during the first four 
national test: dates of the preceding school year. 'The 1973 Profile 
contains information on 8,701 boys, and girls who participated in 
this optional program in • the school year 1972-73. This number re- 
presents approximately 42% of the 40-day ADM f 18,489 twelfth grade 
students .reported in 1972-73, a decrease from 45% the previous year. 
Of those students taking the test, 90% were seniors, 7% were juniors, 
and 3% were classified as -Other." The number of girls participating 
in this assessment has increased over the past six years until they 
now constitute a majority of those tested. 

The ACT Assessment consists of two sections in which different 
types of information are collected. One section includes the four 
measures of academic ability. The other, called the Student Profile 
Section, asks for information about additional student characteris- 
* tics that appear to have a bearing on success in college. 

A description of the ACT is found in Assessing Students on the 
Way to College , Volume Two, Page 3: 



• Each of the ACT Tests is oriented toward one 
of the four primary subject-matter areas of college 
and high school instruction. Thus, the English test 
is designed to measure the student's understanding 
and use of the basic elements in correct and effec- 
tive writing; the mathematics test, the student's 
mathematical reasoning ability? the social studies 
test, evaluative reasoning and problem-solving skills 
required in the social studies; and the natural sciences 
test, the critical reasoning and problem-solving skills 
required in the natural sciences. The average of a stu- 
dent's scores on these four tests is his ACT Composite 
Score, which may be considered an eS'timate of his over- 
all academic ability. ■^ACT Scores are reported on a 
standard score scale that range's from 1 to 36. The 
standard error of measurements is about 1.0 for the 
ACT Composite and about 2.0 for each of the four ACT 
tests. 



' In the Student Profile section, among other information, stu- 
dents give the last grade received prior to their senior year in 
the areas measured by the test, i.e., English, matheiratics, social 
studies, and natural sciences. The average of these four grades 
gives a high school average (HSA) which provides another measure 
of academic ability. 

Table 1 gives New Mexico means for 1967-68 to 199^=2^ and the 
most recent National norms based on those students tested from 1970 
through 1973. Graph A displays New Mexico scores attained from 
1970 through 1973 and compares them with National results. (See^ 
Table 1 and Graph A on the following pages.) 

Looking at total scores alone, it appears that the downward trend 
noted in previous years has been halted or reversed in all areas but 
social Studies for New Mexico students, while at the National level 
scores have dropped in everything but Natural Sciences. (See Table 2) 
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Table 2 



1971-72 1972-73 Difference 1967-70 1970-73 Difference 





New 


Mexico 






National 


- 




Engliah 


17.1 


17.2 


+ .1 


18.2 


17.7 


-.5 




Natheaatica 


18.0 


18.0 




19.0 


18.7 


-.3 




Social Studiaa 


17.7 


17.1 


-.6 


19.4 


18.3 


-1.1 


■/ 


Natural Sciences 


20.2 

m 


20.3 


♦ .1 


. 20.1 


20.4 


+.3 


1 


Conposite 


18.4 


18.3 


-.1' 


19.3 


18.9 


-.4 





' ,1 



This corresponds to the finding that scores on the 5?cholastic 
Aptitude Testf, another widely used college entrance test, are dr)ap- 
ping nationwide. This phenomenon was a topic of discussion at a con- 
ference of directors of state testing programs held in Princeton, 
New Jersey* on November 4 and 5, 1973. It was reported that the 
Minnesota College Testing Program mean scores had experienced an in- 
crease until approximately 1961-62 where they plateaued until about 
1969-70 when the iresn scores began dropping approxiir4it|cly i/2 raW 
score point annually.* In addition, it has been noted that National 
scores on the reading and math portions of the Iowa Tests of B^sic 
Skills are showing "substantial drops," particularly , in the higher 
grades. 



* Minutes, Conference of Directors of State Testing Programs, ETS, 
New Jersey, November 4, 5, 1973. 

**Ibid. 
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• Some possible reasons for this were suggested which might be 
extrapolated to performance on the ACT: ^ 

t • • • 

Changes in the population tested - more^ minority group 

and -low socio-econgmic status students participating; 
increased urbani2'&tion« . 

Changes in attitude toward testing - college entrance be- 
coming less important to the more academically talented 
students who jlnay either not participate in the test or 
;nay riot be mcltiyated to do their best. 

Changes in curri(iulum - decreased emphasis on basic skills 
and more onl life, adjustment courses ajad the affective 
domain, whilch are not measured by the tests under dis- 
cusSioi. 

Changes in teacJher attitude ^ increased resentment on the 
part of s^me teachers and activism directed toward 

. changing what is perceived as their second-class status 

• • » * ■ 

and lack of financial incentives to do their best in 
teaching and motivating the,ir students. - 

Whatever the reasons for c^clihing performance,, an examination 
of Table 1 indicates that the lower leores * attaihed by New Mexico girls 
who took the ACT in 1972-73, particulary in Social Studies, are th$ - 
'primalry reason for Blew Mexico's composite score, decrease, since boys' 
scores st^w an upward trend in all areas exG;ef>t sdcial studies, and 



that 'only decuredses A of a sta^idard score. Graph B illustrates the . 

^perfonnance* of New Mexi.cov students in the 1972-73 assessment period 

: *, ' - .' « 

" and -that of ^he National population over a three-year span. „ 

* ' • ' . . . ^ • ■ • • ; 

In the section of the Student Profile in which high school grades 

are re^rted, girls indicate that they receive nigher grades than boys 
» . *■ 

.^^n all four areas and the highest grades of in Social Studies. 

See. Table 'a,* t ^ 



^ , Table 3 
Vih. ^ 

Distribution of High School Grades* 1972-73 





English 


Math 




Social Science 


Boys 


' 2.79 


2.52 




3.04 / ^ 


Girls 


3.08 


2.53 

... • 


f [ 


»3.08 » • 


'Total 


2; 94 ^ ' 


2.52 




3.06 


M.OO point system. 






4 



Natural Sciences 
2.76 

2.81 



It -would appear from these two factors, i.e., higher grades in 
high school and lower ACT scores, *that New Mexico college-bound girls 
are not being prepared adequately for tbe^ competition they will face 

r 

in college. The possibility of item bias has been raised and the l(e- 
search and Development Division of the American College Testing Pr&gram. 
plans to investigat:e this contingency, but it is hardly likely that this 
could ac^unt for such- a large difference in scores attained by boys and 
girls. Some other possible fac^prs m^ght be variations A curriculum,. - 
teacher preparation, grading practices, and -appropriateness of test itferos 
for New Mexico high schools, especially in the area of social Studies. 



In a paper prepared for a 1972 invitational conference on testing - 

f • . 

problems, li^anor Er Maccoi>y and Carol Nagy Jacklin, of Stanford Uni- 
versity,. stated that, " [ regardingl the performance of the two sexes 
on measures of total or composite abilities, such as I. Q. testss It is 
still a reliable generalization that there are no sex differences on 
these tests.**"* 



They go on to reaffirm the conclusion that boys are better at cer- 
tain kinds of it.ems and girls at others, so the particular mix of items 
can determine the outcome. Girls' verbal superiority should give them 
an advantage in a test such as the ACT, which relies heavily on reading 
cooprehension in all subtests, but this is not the case in New Mexico. . 
Their closing paragraph gives an indication of the difficulty in drawing 
any firm conclusions: 

We feel we should apologize for having given you a recital * 
of what we do not know about the origins of intellectual 
sex differences. We would like to have been able to be 
more positive. But perhaps divesting ourselves of some 
misconceptions may not be' a bad way to begin the complex 
task of understanding the factors that underlie sex dif- 
ferences in intellectual, functioning.** ^ 

New Mexico students, boys and girls, do not fare too well when their 



scoies are con^jared with other states in this region. In a longitudinal 
study conducted by Dr. William Huber, Dean, University College, Univer- 
sity of New Mexico, a comparison of the performance of UNM freshmen from 
1966 through 1972 with National and Regional norms revealed that: 



* Assessment In A Pluralistic Society , Proceedings of the 1972 Invitational 
Conference on Testing Problems, ETS, Princeton, N. J. 1973, "Sex Dif- 
ferences in Ir«-ellectual Functioning," pp. 37-55. 



It is readily obseijvable that performance on all 
'*t>a**"ts of the ACT tests of UNM freshman cjlasses since 
1967 has declined. The decline has been substantial, 
to the point that in 1972 the UNM freshman class is 
ec^al to or below national norms for all colleges and , 
universities using the ACT service. Furthermore, na- 
tional norms have tended to' remain stable andthe re- 
gional Group ly norms have remained about the same 
in 1971 and 1972. UNM freshmen equaled or exceeded 
regional and national Group IV norms in 1966 and 1967. 
In 1972 the UNM freshman class has fallen considerably 
below these Group IV norms.* 

Another indication of New Mexico's declining performance is 
found in comparing scores of resident and non-resident students^ 

The change upward in the proportion of non-resident 
students has not contributed to the previously reported 
decline of performance on the ACT tests* In fact it has 
had the reverse effect in that the non-residents have 
averaged 21,6 and higher on the ACT whiles overall UNM 
norms were dropping from 21,9 to a current low of 19«7. 
If the non-residents were subtracted from the freshman 
population, the UNM norms would be lower than the current 
19.1.** 



One possible explanation that has been proposed to accoxant for 
New Mexico's poor showing is that more students are taking the test 
each Vftar, implying that less able students are participating and 
depressing the scores. However, 406 fewer students took the test in 
1972-73 than in 1971-72, with no improvement in scores, and, according 
to the jhigh school grade averages rJ^Jorted in Table 3, they were in 
the upper half of their class. Grades, however, are not necessarily 
indicative of course content. 



* "The university of New -Mexico Freshman: A Longitudinal Study of Se- 
lected Characteristics 1966-1972," William H. Huber, Dean, University 
College, p. 17. 

**Ibid. p. 24. • ' 



In summary. New Mexico's tctal composite sccro on, the 1972-73 
administration of the ACT has continued the downward trend which be- 
gan in 1969-70. The decline for .the most recent year can be attri- 
buted almost entirely to the low scores attained by New Mexico gi.rls, 
particularly in social studies, since boys' scores generally have 
improved. Actual high school course grades reported by these stu- 
dents in the subject areas tested are higher in social studies than 
any other subject. The latest national - norms follow somewhat the 
same pattern as New Mexico, though at a higher level. Course content 
and grading practices should be carefully reviewed, since it appears 
on the basis of the ACT that New Mexico students may be handicapped 
in academic participation at the collegiate level by inadequate pre- 
paration in secondary school. 
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Grade 
Level 



APPENDIX A 

» 

TESTING SOIEDULE - 1969-1974 

* » 

Instrugertt (s) 



Years Administered^ 
1969-70 1976-71 1971-72 1972-73 1973-74 



Otla-Leimon Mental 

Ability Test~ 



- ^ 



« 



Conprehensive Tests o£ 
Basic Skills 

April (Sample) 

October 

California Test of 

Mental Maturity 

J^ril (Sample 

Short Form Test of 

Acadeaiic Aptitude 

October 



X X 
X 



X 



X 



8 



Comprehensive Tests of 
Basic Skills 

April (Sample 

October 

California Test of 

Mental Maturity 

April (Sample) 

Short Form Test of 

Academic Aptitude 

October 



X 
X 
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N « 24, 396 



Test 1 (40 items) 

28 items 

Test 2 (45 items) 

Literal Meaning 
17 
33 
40 
44 

Simple Rewording 
7 
9 
.15 
19 

":~-_27 - : . 
29 

Pauraphrasing 
10 
16 
26 
30 



APPENDIX D 
GRADE 5 - ITEM. ANALYSIS 
OCTOBER 1973 . 



Reading Vocabulary 

Best meaning, rr. four choices 

10% or more below 
National Reference Group 

Reading Comprehension 
Best Answer - four choices 



from text 



It N 



implied in text ^ 



II II 



implied' in text 



5.1 5.6 

STATE NATIONAL 

Percent Right* 
.55 68 



DIFFERENCE 



13-.- 



54 


65 


11 


52 


62 


10 


52 


65 


13 


76 


88 


12 


46 


56 


10 


29 


39 


10 


59 


75 


16 


63 


83 


20 


57 


75 


18 


70 


82 


12. 


47 


64 


17 


59 


75 


16: 


60 


72 


12 


61 


74 


13 


54 


,72 


18 


52 


69 


17 


62 


73 


11 


56 


71 


15 



* state figures derived from administration of comprehensive Tests of pasic skills 
(CTBS) Form Q, Level 2, in October 1973. National Reference Group (NRG) tested 
■■ in March 1968. 
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Test 2 Cont'd 

a 

Interpretation 
Main Idea 
S 

13 

22 

31 
34 
37 

Relationships 
' 2 - 
4 
32 
36 
42 

Conclipions 
28 
3^ 
43 

Inference 
1 
23 
24 
39 



STATE NATIONAL 



of a poem . 
;Of a letter 

story of king's daughter. 
Shining Noon, and horses 

best title 

description of process 
best title 

higher than 
rhyming words 
organization of facts 
two ways of doing something 
appearance and reality 

from infornation in text 
ft ti tt II 



from information in text 



II tt 



ti It 



50 
54 
63 



60 
62 
76 



DIFFERENCE 

IP 
8 

13 • 



70 


81 


11 








A C 

HO 


DD 


10 


A O 

49 


ou 


11 

m 


At\ 




14 

x*« 


A A 


cc 


11 

X X 


fH 


Oo 


12 


OD 


/ o 


13 




47 


13 


Z / 


37 


10 






12 


A A 


J** 


10 


55 


66 


11 


45 




. .16- 


44 


55 


11 


55 


66 


11 


69 


79 


10 


53 


68 


15 


74 


84 


10 


41 


56 


15 



•Above National Reference Group 
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Test 2 Cont'd 



STATE NATIONAL 



DIFFERENCE 



Ai^alysis 
14 

21 
35 



from infortnation in text 



11 II 



tt II 



61 
66 
63 
56 



73 
76 
73 
70 



12 
10 
10 
14 



Test. 3 (25 items) Language Mechanics 

^confusing directions) 



Punctuation 
1 

2 
3 
4 

5 

6- 
7 

* 

i 

9 i • 

10 
12 

13 

Capitalization* 
14 

15 



ccQona between city and 
statie 

coaina after salutation 

period at end of sentence 

close quotation 

question mark 

comma after coir^limentary 
close ' ' ' 

before dependent clause 

period at end of sentence 

perio4 after abbreviation 

cotnma before quote 

comma before independent 
clause 

question mark 

words in title 
middle initial 



48 

58 

78 
67 
63 
53 
61 

72 
66 
62 
30 

S2 — 

51 
51 
36 • 
53 
39 



64 

71 

89 
77 
77 
68 
77 

84 
78 
79 
46 

66 

61* 
.69 
56 
69 
64 



16 

13 

11 
10 
14 
15 
16 

12 
12 
17 
16 
14 

10 
18 
20 
16 
25 



• .V 



rest 3 cont'd 
T ^ 

\ 



STATE NATIONAL DIFFERENCE 



17 
18 
19 
20 
21 

23 
24 
25 



\ 



name of country 
name of month 
no mistakes 

* 

first word of quote 

words in title * 

initials 

proper name 

name of month 

quote 

"^projper name 



42. 


63 




21 


• 


t 40 


60 


• 


20 




45 • 


69 




24 










• « 




21 


27- 




6 ' 




23 


38* 




- 15 7 . 

• 




43 


67 


*< 


•24 - 










* • 




• 33 


51 




18 ■ 


# 


35 


56 


♦ . ■ 


21 




34 


52 




18 














28 


50 




22 





* 10 to "35% omitted each item 'in this subtest which is the last section, possibly . 
indicating lack of time, rather than lack of knowledge. ' • . *■ 



Test 4 (30 items) 



Correct Usage 
28 . 

; 30 

31 - - 
,33 - 
34 

Edonomy/clarity 



Language Expression 
Best wor4 or phrase 

they're (they are) 
your 



^'a- "an" 



"themselves" 
"least" 



A choice of phrases 
including "Best as it is' 



I 



51 

57 
41 
64 
47 
57 
27 
34 



62 

68 
58 
77 
65 
68 
41 
43 



11 
11 

17- 
13 
18 
11 
14 
9 



ERIC 
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Test 3 cont'd 



NATIONAL 



DIFFERENCE 



Word Choice 



Words which fit best 
in each sentence 



Test B (30 items) \ Spelling 



25 items 10% or more belo« 
below Natiohal Reference firaap 



65 



69 



12 



15 



Test 6 (48 items) Arithmetic Computation i 



Additioa 
17 
-18 
19 
20 
33 
34 
35 
36 

Subtraction 
7 

8 

21 
✓ 

22 



4 digit, whole nudnbers 
decimals, money 
decimals, tens 
decimals, hundreds 
common fractions 
." " 

mixed fractions 



2. digit whole numbers, ^ 
regrouping 

3 digit, whole numbers, 
regrouping 

4 digit, whole numbers, 
regrouping 

4 digit whole nund>ers, 
reg roiling 



55 
64 

72 
78 
64 
62 
31 
18 
53 

yi 

59 
66 

66 

64 

50 



73 

77 

82 

90 

74 

76 

61 

39 

76 

47 

77 

83 

80 

80 

9 

72 



18 
13 
10 

n 12 
10 
14 
30 
18 
' 23 
16 > 
18 

r 17 

14 

16 
22 



Test 6 Cont'd 



STATE NATIONAL DIFPEREWCE 



< 23 " 




decimals » money . 




87 


13 

A 


24 




decimals, money » regrouping 


47 


68 


• ; 21 \ 


3i7 ■ 




decimals » tens /regrouping 


35 


51- 


• 16 


38 


• 


coDBOn fractions 


51 ■ 


77 


26 


39 




M It • 

/ 


31 


. 63 


32 


.40 , 


X 

J 


' mixed fractions 


47 

ft 


69 


22 


Multiplication 


• 


51 


70 


19 


9 




1 Jk^m\^ ^ #94 fv4 ^'e 


83 


94 


11 


10 








■t 


15 


11 




** X 2f regroupin? 


7Q 


91 


12 


12 




X 2f re9'oupin9 


73 


88 


15 


25 




, " " X 3, regrouping 




ox 


24 


26 




• *• X 4# regrouping 


dX 




22 


27 




^ X 3 regrouping, decimal 


48 




27 


28 .. 




2 digits X 2 


39" 


69 


30 


41 




X 4# decimal 


32 


.57 


25 


43 




ccmiApn fractions 

... . . . . ? • 


14 


31 


17 


44 




38 

• 


.58 


20 


Envision 






47 


67 


20 


13 




1 digit into 2 ' , 


75 


92 • 


17 

4 


14 






77 


89 


12 


15 






72 


89 


17 


16 




H •• w 3 


50 ' 


78 


28 



Test 6 cont'd 

\ 

29 
, 30 
31 
32 

« 

45 
47 



STATE RATIONAL dll'FERRWCB 



1 digit into 3 



U. . I« 



V 4 , decimal 
•• 3 

" 4 , decimal 



coKinon fractions 



45 
43 
46 
50 
30 
29 



73 
65 
78 
78 
47 
5ii 



28 
22 
32 
28 
17 
22 



Test 7 (30 items) Arithmeti c ■ Concepts 



\ 



Recognition 
2 ' 
. 9 
14 

20 . 
27 

Translation 
1 ♦ 
29 



30 



Equations 
13 
15 



place -values 
greater than 



( 



place values^ decimal 
"square inches' measure what? 
place values 



words to figures 
geometric terms 



value of "h" 



completion 



54 
54 
45 
72 
62 
33 
42 

58 
72 

f 

/ 

38 

67 

57 
55 



68 

i . 

'66 

I 

61 

76 
46 
53 

70 
84 

56 
52 

78 
68 



14 

12. 
16 
13 
14 
13 
11 

12 
12 
14 
14 

11 
12 

13 



r 



ERIC 
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Test 7 Cont'd 



STATE NATIONAL DIFFERENCE 



Comparisons 
4 



greatest divisor 



52 

26 



if 



8 
17 
23 

Other Relationships 
3 
18 
19 
25 
26 

Analysis . 
16/ 
22 
24 
28 



longest/ distance 
greatest value 
shorter length 



the weelc after 
map scale 

missing numeral in sequence 
fraction of area 



finding average , 
time r hours after 



volume 



\ 



smallest Value 



70 
26 
56 

^4 

53 
57 
44 
48 
53 

45 
62 
42 
35 
21 



69 
53 
80 

•T 

55 
70 

72 
69 
75 
58 
74 
81 

57 
78 
55. 
46 
37 



17 
. 27 
10 

V 

14 

18 
. 16 
18 
14 
26 
28 

12 
16 
10 
11 
15 



Test 8 (20 items) 
Selecting Method . 
37 
, 40 
42 
■ 43 



Arithmetic Applications 

finding cost 
width of room 

number of windows washed ^ 
tickets purchased 



47 
38 
46 

ii 

51- 
50 



62 
56 
62 
50 
77 
69 



15 
16 
16 
13 
26 
19 
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Test 8 Cont'd 



STATE NATIONAL DIFFERENCE 



47 
49 

50 

Solving Pr^lem 
31 
32 
34 
35 
. 36 . 
39 
46 

Organization 
38 
41 
45 



finding fraction of total 
average height 



30 
23 



47 
40 



17 
17 



converting feet to inches 



finding unknown 
hcHirs to minutes 
division 
2 process^es 
cents to decimal 
determine process 
fractions 



finding unknown 
teiqperature 
finding unknown 



32 

47 
61 
78 
65 
61 
56 
54 
42 

44 

47 
48 
30 



48 

62 
80 
88 
80 
72 
75 
70 
62 

55 
61 
59 
51 



16 

15 
19 
10 
15 
11 
19 
16 
20 

11 
14 
11 
21 



T68t 9 (20 items) 
Parts of Books 

Dicti<mary use 

Library Use 



Study skills - Reference 



45 
45 

45 

45 



58 
59 

60 

56 



13 
14 

15 

11 



\ 



1 



STATE NATIONM. DIFFERENCE 



Test 10. (30 items) Study Skil ls > Graphic 



Translation 



52 



56 



64 



66 



12 



10- 



Relationships 



54 



68 



14 



conclusions 



50 



63 



13 



Analysis 



45 



58 



13 



\ 



/'■• 



\ 
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N » 24,782 



Test 1 (40 iteats) 



26 items 



APPENDIX E 
GRADE 8 - ITEM ANALYSIS 
OCTOBER 1973 



Beading Vocabulary ! 
Be^gt^^aning - four choices 

10% or more below the National 
Reference Group 



8.1 
STATE 



59 



8.6 
NATIONAL 



69 



DIFFERENCE 



10 



Test 2 (45 items) Reading Comprehension 

Simple Rewording - Best Answer 
four choices 



Paraphrasing 
5 
12 
24 
36 
42 

Zntexpretation 
20 
26 
34 
38 
45 



French phrase - meaning? 
Ifhat century? 
"tall tale* 

boustrobhedon - given in test 
poem -/poor choice 



Best Title 
Main thought 
Best title 
Main thought 
Best title 



59 
64 

61 
31 
42 

51 
68 

61 
31 
36 
48 

51 
40 



68 
72 

71 
44 

68 
81 
61 
82 

71 
47 
55 
68 
63 
56 



9 
8 

10 
13 
26 
14 
10 
14 

10 
16 
19 

20 
12 
16 



Test-2 Cont'd STATE NATIONAL DIFFERENCE 

Relationships. 56 63 7 

40 Inference 43 56 13 

4 1, „ Similar i ty of sound - poftm — _ 20 10 

» 

Conclusions 59 69 10 

16 Inference 57 70 13 

17 Inference 52 69 17- 
33 Inference 48 59 11 

inferences 59 69 10 

1 Turkish Language spoken 75* 74 +1 

Izmir in Turkey ^ 

22 of tree . 63 77 14 

23 Attitude of author 53 64 11 

30 Car components at no 37 48 11 

extra cost 

32 "Plain Jane" - car 62 78 16 

Extended Meaning 60 68 8 

25 What d chronometer measures 55 70 15 

Test 3 (25 items) L^guage Mechanics 60 68 8 

Punctuation "^^ ® 

1 Use of colon after salutation 72 83 11 

3 Incorrect use of cc»nma 55 70 15 

5 Use of colon before list of 51 66 15 

items 

*Above National Reference Group 



Test 3 Cont'd 



STATE NATIONAL DIFFERENCE 



Punctuation Cont'd 

. 6 Ose of comma in series 



11 



Capitalization 
16 
20 
22 
23. 
24 
25 

Test 4 (30 items) 

31 
32 
33 

Economy/Clarity 



Incorrect use of comma 



Beginning quote 

Name of month ■ 

Words in a title 

Words in a title ^ 

Words in a title 

Name of a species 

Language Expression 

Correct Usage - missing words 

Present perfect 

Use of "wljose" "who's" 



Use of "its" (possessive) 



Choose best 

wording from four possibilities 
including "Best 
as it is." 

Last five questions pertain to 
a poem and must fit meter as 
v/ell as meeining. 



Interpretation - Word. Choice - 10 items 

Best word. 



64 
62 

54 

32 

75* 

44 

54 

31 

47 

53 
61 
38 
44 
35 

42 



57 



75 
75 

61 
43 
72 
56 
66 
53 
57 

64 
70 
54 

66 
58 

52 



70 



11 
13 



7 
11 
+3 

12. 
12 
22 
10 

11 
9 
17 
22 
23 

10 



13 



Four choices* 



♦Above National Reference Group 
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STATE NATIONAL DIFFERENCE 





Qn^1 1*1 no 


58 


70 


12 


5 items 


10% or more below 
National Reference Group 








Test 6 (48 items) 


Arithmetic Computation 


60 

- • 


73 


13 


Addition 




63 


76 


13 


1 


Money • decimal 


95* 


92 


+3 


2 


4 places 


91 


91 


0 


17 


Mixed fractions 


45 


71 


2o 


18 


fractions - common & decimal 


66 


77 


IX 


19 


" - ccmmon 


53 


73 


20 


20 


- mixed 


57 


75 


18 






47 


70 


23 


34 


Fractions - mixed 


65 


78 


13 


35 


Fractions - mixed 


51 


72 


21 


36 


Fractions - mixed 


46 


61 


15 


Subtraction 


- 


- 

57 


70 


13 


6 


Decimals " two places 


86* 


82 


+4 


8 


- to four places 


41 


54 


13 


21 


Fractions - connon 


58 


78 


20 


22 


" - mixed & decimal 


44 


66 


22 


23 


- coBBion 


63 


76 


13 


24 


" - mixed 


64 


78 


14 


37 


Involving exponents 


42 


62 


20 



* Above National Reference Gxoup 



Test 6 Cont'd 

Subtraction Cont'd 

38 Fractions - mixed 



STATE NATIONAL DIFFERENCE 



39 
40 

Multiplication 
27 
28 
41 
42 
43 
44 

Division 
16 
32 
45 
46 
47 
48 



Test 7 (30 items) 
Recognition 
2 



%^ole no. & fraction 
- mixed 



whole no. & fraction 



2 fractions - commom 



- mixed 



Involving trinomials unknovms 
Mixed no. & coranon fraction 



Comnon fractions ^ 



Whole no, & coinnon fraction 



fl M It 



Mixed 



M II II 



Two steps 

Arithmetic Concepts 

Expanded numeral form 
Geometry 



38 



34 
62 

61 
52 
48 
49 
43 
47 
38 

61 
67 
44 
38 
38 
45 
46 



61 
61 
65 
63 



55 
57 
75 

73 
74 
72 
66 
60 
64 
55 

73 
78 
61 
54 
54 
65 
69 



71 
73 

75 
80 



17 
23 
13 

12. 
22 
24 
17 

17 
17 



12 
11 
15 
16 
16 
20 
23 



10 
12 
10 
17 
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STATE NATIONAL DIFFERENCE 



Test 7 Cont'd 
17 

ai 



24 

Translation 
1 

19 
23 

25 
27 
28 
30 

Equations 
8 

Ccunparisons 
13 
20 
22 

Organization 
7 
11 



Division 

Lace— values 
Geometry 



Place value - money 
Exponents 

Changing decimal to common 
fraction 

Changing % to decimal 
Changing words to figxires 
Geometry (diameter of circle) 
Identifying right angle 



Simplifying Arithmetic expla- 
nation 



Measurement example 
Approximation of measure 
Comparing comnon fraction & % 



From inch to cm. 



" ineter. to yd. 



62 
-48 
47 

57 



91* 

59 
48 

42 
38 
61 
52 

72 
77* 

59 
69 
50 
42 

61 
59 
57 



72 



66 



61 

69 
89 
73 
69 

63 
57 
73 



77 
76 

73 
79 
67 
64 

68 
69 
72 



10 

18 - 

14 

12 
+2 
14 
21 

21 
19 
12 
10 

5 
+1 

14 

10 
17 
22 

7 
10 
15 



* Above National Reference Group 



FRir 
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STATE NATIONAL DIFFERENCE 

ft » 

Test 7 Cont'd 

Organization. Cont'd ' ^ 



12 


Estimate amount in mililiter 
graduate 


68* 


64 


+4 


'■ ^ 15 


% of geoii^tric figure not 
shaded 


60 


72 


12 


26 


Formula for N of shaaea oxqcks 


AO 


57 


15 


Test 8 <20 items) 


Arithmetic Applications 


;56 


71 


15 


Interpretation. 


• 


56 


'71 


15 




Selecting method 


55 


70 


15 


43 


Two operations 


58 


72 


14 


45 


Find average of 3 numbers 


50 


67 


17 


50 


Change inches to ?eet 


33 


54 


21 


Solving problem 




61. 




13 


31 


Fractions 


84* 


82 


+2 


J' 


Square feet 


40 


72 


32 


48 


Fractions 


40 


64 


22 


Other relationships 


52 


. 69 


17 


33 


Ratio 


54 


71 


17 


35 


Ounces & pounds 


36 


61 


25 


38 


Feet and yards 


52 


68 


16 


39 


Gallons and pints 


34 


54 


20 


. 40 


Map scale 


65 


79 


14 



* Above National Reference Group 



ERIC 



STATE NATIONAL ' DIFFERENCE 



i 



Test 8 Cont'd 

Analysis - Organization 

41 Monthly payments vs lump sum 

44 Fractions 
•47 Averages 

49 Per cent 

Test 9 (20 items) Study Skills - Reference 

Dictionary Use . . 
16 
18 

Library Use 

7 , 
10 



Parts of speech 
Definitions 



Alphabetizing 



Test 10 (30 items) Study Skills. - Graphic 

Converting Symbols 

21 Map & Legend 

• 50 Interpret bar grapli^ 



Belationships 
23 
24 



55 
68 
55 
56 
41 

61 

58 
54 

56 



61 



57 
71* 

57* 



7b 
78 
73 
69 
59 

66 

64 
64 
67 

67 
69 
70 

54 



15 

10 
18 
13 
18 



6 

10 
11 

6 
12 
+1 

+3 



Interpret map-agri regions 



57* 


51 


+6 


79* 


- 63 


ifl6 


'50* 


47 


+3 


60* 


56 


+4 


83* 


76 


•♦■7 


75* 


73 , 


+2 



* Above National Reference Grot:^ 



STATE NATIONAL DIFFERENCE 



Test 10 Cont'd 

Ralationships 
26 
35 
36 
39 
40 
47 

Conclusions 
22 
29 
34 
41 
42 

43 

44 

49 

\ 

Extended Meaning 

\ 

31 



Interpret map-- topo 

Diagram - profile 
Interpret graph - temp. 



" bar " - % of studenLs 



Using map 



** Profile diagram 

** table 

Table - which country d 
gained least 

Table - smallest difference 
in production 

Table - most gain 

Graph 



How high above sea level is 
tallest peak? 



72* 
48* 
44* 

• 

52* 
62* 
64* 

54* 
75* 
52* 
57* 
70* 
28 

33 

67* 
58* 

56* 
85* 



65 
47 
39 
49 
56 
59* 

^2 
67 
44 
52 
67 
32 

40 

64 

50 

I 

55 
75 



+7 

+1 
+5 
+3 
+6 
+5 

/ 

+2 
+8 
+8 
+5 
+3 
4 



+3 
+3 

+1 
+10 



* Above National Reference Group 
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APPENDIX F 

I. 

GRADE 5 - ITEK ANALYSIS 
APRIL 1911^ . 
CTBS ,FORH Q XJBVEL 2 



0 - 



N » 14,136 
Test 1 (40 items) 
22 items 



Reading Vocabulary 

Best meaning - four choices 

5% or more below 
National Reference Group 



Test 2 (45 items) Reading Comprehension 



Literal Meaning 
17 



from text 



SiB^le Rewording " 
7 

19 
27 



from telct 



I 

H 



/ 



Paraphrasing 

8 I 
10 
. 16 
'30 

Main idea 
5 

11 



from text 



of a poem 



best title 



,5.7 5.6 

STATE NATICaaAL DIFFERENCE 



62 67 



^1 
ox 


65 


4 


59 


62 


3 


59 


65 


_6 


-69 


75 • 


6 


75 


83 

• 


8 


67 




8 


58 


"64 

♦ 


' 6 


66 


•■ ^ 75 


a 


•68 


74: 


• 

6^ 


82 


87 


5 


66 


72 


6 


58 


- -69 


11 


64 ■ 


71 


. 7 


59 


61 


' 2 


70 


76 


6 


65 


70 


5 



ERIC 
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5.7 5.6. . 

STATE NATIONAL DIFFERENCE 



Test 2 Cont'd 

■II u ' • 

Maih Idea Cont'd 



13 



22 



Relationships 
2 

I 

4 . 

t 

36 

Conclusions - 
28 
38 

Inferences 

4 

* 39 . 

Analysis . 
6 
14 
35 , 

Test 3 (25 items) 
^ / 

3 
5 



of a letter 

story dealing with ^ 
king's daughter named 
Shining Moon, and horse 



dezfiving ineaning from poem 
rhyming words 

two ways df doing something 



From infomation in text 



^ from text 



from inforntati^n in text 



II II 



.1 ^ « 



^language Mechanics' ^confusing 
directicMis* 



j^eriod at end of sentence 
question mark, 



74 



64* 



51 
80 
71 
32 

. 50 
60 
53 

61 
60 
50 

58 
65 
71 
64 

60 

67 
71 
70 



81 



56 



55 
86 
78 
37 

54 
66 
61 

66 
68 
56 

72 
73 
76 
70 

63 

71 

77 

. 77 



7 
+8 



4 
6 
7 
5 

4 
6 

8 

;5 
a 

6 
4 

a 

5 
6 



4 

6 
7 



* Above National Reference Group 

9 



Test 3 <:ont'd 
Pu»\ctuation Cont'd 

8 

9 
13 

Capitalizat ion 
. '15 

17 

18 

19 

Test 4 -(30. items) 

Correct Usage 
28 
31 
34 

. 35 .. 

Economy/Clarity 
Word 0ioice 

Test 5 (30. items 
• 5 items 



period at end of sentence 
period after abbreviation 

r 

question mark 

middle initial 
name of month 
no mistakes 
first word of quote 

Language Expression 
Best word or phrase 

possessive "their" 
use of "a" and "an" 
use of "less" "least" 
use of "who" and "whom" 

A choice of phrases ^ 
including "Best as it is" 

Words which fit best in 
each sentence 

Language - spelling 

5% or more below National 
Reference Group 



S.7 5.6 

STATE NATIONAL DIFFERENCE 



72 79 7 

37 46 9 

61 69 8 

54 55 1 

55 64 9 ^ 
54 60 6 

64 69 5 
31* 27 +4 

58 '59 1 

65 68 3 
53 &8 5 
57 65 8 
36 41 5 
63^ 68 5 

42 43 1 

59 64 5 

68 69 1 



Above National Reference Group 



S,1 5.6 
STATE NATIONAL 



DIFFERENCE 



Test 6 (48 items) Arithmetic Confutation 



Addition 
33 

34 ' 
35 

Subtraction 
22 
38 
39 

Multiplication 
42 
43 
44 

Division 
13 
15 
31 
32 



common fractions 



mixed fractions 



ERIC 



four^digit numbers 

I 

comon fractions 



cooiiion fractions 

whole number and fraction 

coanton fractions 



whole numbers 

N M 

/ 

pecimal 
mole numbers 



Test 7 (30 items) Arithmetic Concept 



Recognition 
2 
9 
14 

i 

20 1 



place values 
greater than 

0 

1 

place values 

square inches measure areas 



70 

73 
44 
33 
68 

73 

67 
69 
56 



73 

76 

61. 
^9 
76 

76 
72 
77 
63 



68 



76\ 



41 



3 
17 
6 
8 

3 
5 
8 
7 



+5 

7. 

/ 

+6 

2 

5 

, 5 
6 
5 



5 
17 
7 
7 



* Above National Referei>ce Group 



5*7 
STATE 



5.6 

NATIONAL DIFFERENCE 



Test 7 Cont'd 

Traa&latiea 

Equations 
10 
15 

Comparisons 
4 



finding unknovm 



17 
23 



greatest divisor - four 
choices 

smallest value - four choices 
(%) 

greatest value four choices 
(common fractions) 

shorter than - inches 



Other Relationships 

3 "one week after" 

18 road map scale 

19t missing numeral in ries 



67 

74 

76 

63 

62 
43 

84 

44 

64 

68 
61 
68 
53 



70 

77 
81 
68 

69 
53 

89 

55 

70 

72 
69 
75 
58 



3 

5 
5 

7 
10 



11 



4 

8 
7 
5 



Analysis 

Organization 
16 

28 



information needed to 
solve problem 

smallest value %'and 
cocinon fraction 



53 

53 
72 

30 



56 

56 
78 

37 



3 
6 



Test 8 (20 items) Arithmetic Applications 



60 



65 



ERIC 



-65- 



5.7 ' 
STATE 



b.6 
NATIONAL 



DIFFERENCE 



Test 8 Cont'd 

Sielecting . Method 
\ 37 

431 
47 

A 

49^ \ 

Y 

Solving Problem 
31 
32 
34 
36 
39 
46 

Organization 
33 
38 
41 
44 

45 • 



/ 



finding cost 

number of windows washed 
niunber of tickets purchased 
finding fraction of total 
average height 



finding unknown 

t ■ * 

hours to minutes 

division 

cents to decimal 

determine process 

fractions 



finding unknovm 

M N 

temperature 
finding unknown 



Test 9 (20 items) Study Skills - Reference 



Parts of books 



Test 10 (30 items) Study Skills - Graphic 



Translation 



60 
57 
67 
62 
38 
35 

69 
73 
83 
75 
68 
63 
56 

50 
62 
54 
54 
47 
45 

53 
51 

60 

62 



65 
62 
77 
69 
47 
40 

75 

88. 
80 
75 
70 
62 

54 
68 
61 
59 
52 
51 

58 
59 

63 

65 



5 
5 
10 
7 
9 
5 

6 
7 
5 
5 
7 
7 
6 

4 
6 
7 
5 
5 
6 

5 
8 



Mr 



-66- 



Test 10 Cont'd 

Relationships 

Conclusions 



5.7 5.6 
STATE NATIONAL DIFFERENCE 



63 



59 



68 



62 



\ 



ERIC 



-67- 



